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We present a measurement of the unitarity triangle angle (jis using a Dalitz plot analysis of the 
three-body decay of the D meson from the -> D^*^ process. The method employs the 
interference between and J)" to extract both the weak and strong phases. We apply this 
method to the 140 fb~^ of data collected by Belle experiment. The analysis uses 
and B^ — > D* with D* — > Dtv'^ modes, where the neutral D meson decays into Kg-K^TT~ . 
From a combined maximum likehhood fit of B± ^ DK^ and B± D* modes, we obtain 
(t>z = 81° ± 19° ± 13°(syst) ± 11° (model). The 95% confidence interval is 35° < (/>3 < 127°. 



1 Introduction 



The determination of tiie Cabibbo-Kobayashi-Maskawa (CKM) matrix elements ^ is important 
to check the consistency of the Standard Model and search for new physics. Various methods 
using B — >■ DK decays have been introduced to measure the unitarity triangle angle (p^ but 
the statistics accumulated by currently running experiments is not yet sufficient to constrain 
the value of (ps with a reasonable significance. A novel technique based on the analysis of the 
three-body decay of the meson ^ has a higher statistical precision compared to the methods 
based on branching fraction measurements. 

This method is based on two key observations: neutral and mesons can decay to 
a common final state such as KsTt^tt' and the decay B+ D^*^K+ can produce neutral D 
mesons of both flavors via b cus and b ucs transitions, where the relative phase 9+ between 
the two interfering amplitudes is the sum, 6 + (j)^, of strong and weak interaction phases. In the 
charge conjugate mode, the relative phase 9- = 6 — (p^, so both phases can be extracted from 
the measurements of such B decays and their charge conjugate modes. The phase measurement 
is based on the analysis of Dalitz distribution of the three body final state of the meson. 
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In the Wolfcnstein parameterization of the CKM matrix, the ampUtudes of the diagrams 
contributing to the decay B"^ D^{D^)K^ are given by dominant Mi '-^ V*i^Vus ~ AX"^ and 
color suppressed M2 ~ Vub^cs ~ AX^(p + ir]) matrix elements. The two amplitudes interfere if 
the D'^ and 5° mesons decay into the same final state Kgir'^Tr^; we denote the admixed state 
as D. Assuming no CP asymmetry in D decays, the amplitude of the 5+ decay is written as 

M+ = f{ml,ml)+re''t'^+'^f{m'i,ml), (1) 

where and are the squared invariant masses of the Kgir^ and KsTt~ combinations, 
respectively, and f(m+,m-) is the complex amplitude of the decay Ksn~^n~. The 

absolute value r of the ratio between the two interfering amplitudes is given by the product of 
the ratio |y„*5V"cs|/|V^5l4s| 0.38 and the color suppression factor. 
Similarly, the amplitude of the charge conjugate B~ decay is 

M_ = f{ml,ml) + re-^'I'^+'^fiml, ml). (2) 

Once the functional form of / is fixed by choosing a model for Ksn~^n~ decays, the D 

Dalitz distributions for 5+ and B" decays can be fitted simultaneously by the above expressions 
for and M_, with r, (p^, and S as free parameters. The method is is therefore directly 
sensitive to the value of (^3 and it does not require additional assumptions on the values of r and 
S. Moreover, the value of r obtained in the fit can be further used in other ^3 measurements. 

To fit the D — > ifs7r+7r~ Dalitz plot distributions corresponding to S+ and B~ decays, we use 
an unbinncd maximum likelihood technique with the model of neutral D decay determined from 
a flavor-tagged D sample from continuum D*^ Dtt^ decay. The drawback of this approach 
is that only the absolute value of the decay amplitude / is determined directly, but the 
complex form of / can be obtained only with certain model assumptions, leading to substantial 
model uncertainties in the determination of (j)^. These uncertainties, however, can be controlled 
in future using data from cr-factories. The sample of neutral D mesons in a CP eigenstate, 
which can be produced in the decay of ^(3770) resonance, will provide the information about 
the complex phase of amplitude / which is needed for model- independent measurement of (f)^. 

2 Event selection 

For our measurement we use the 140 fb~^ of data collected by the Belle detector.^ The decays 
B^ DK^ and B^ D*K^, D*^ D'^tt^ are selected for the determination of ^3. We 
require to decay to the KsTT'^tt^ final state in all cases. Also, we select decays of D*^ — Dtt^ 
produced in the continuum for the determination of the KsTT~^tt~ decay amplitude. 

To determine the decay model we use D*^s produced via the e^e~ — > cc continuum 
process. The flavor of the neutral D meson is tagged by the charge of the slow pion tt^ in the 
decay D*^ — > Diif. To select neutral D candidates we require the invariant mass of the KsTt^tt~ 
system to be within 9 MeV/c^ of the mass, Mj^o. To select the events originating from the 
D*"^ decay we make a requirement on the difference AM of the invariant masses of the neutral 
D and D*^ candidates: 144.6 MeV/c^ < AM < 146.4 MeV/c^. To suppress the combinatorial 
background from BB events, we require the D*^ to have momentum in the center-of-mass (CM) 
frame greater than 2.7 GeV/c. The number of events passing selection criteria is 104204. The 
fit of the AM distribution yields the background fraction of 3.09±0.05%. 

Selection of B candidates uses the CM energy difference /S.E = ^Ei — Ejj^am ^'^d the beam- 
constrained B mass M(,c = \J E^^^^ — i^piY, where Ebeam is the CM beam energy, and Ei and 
Pi are the CM energies and momenta of the B candidate decay products. The requirements for 
signal candidates are 5.272 GeV/c^ < M^c < 5.288 GeV/c^ and |A^| < 0.022 GeV. In addition, 
we make a requirement on the invariant mass of the neutral D candidate: {Mk^tv-k — M£,o\ < 11 



MeV/c^. To suppress the eontinuum background, we require \ cos 6thr\ < 0.8, where Othr is the 
angle between the thrust axis of the B candidate and the rest of the event. For additional 
background rejection, we use a Fisher discriminant based on "virtual calorimeter".^ 

The selection efficiency of the —>■ DK^ process is determined from a Monte Carlo (MC) 
simulation of the detector and amounts to 11%. The number of events passing all selection 
criteria is 146. The background fraction extracted from the fit of /\E distribution is 25 ± 4%. 

For the selection of B^ D*K^ events in addition to the requirements described we require 
the mass difference AM = M^^^+^-^o — Mk^-k+tt- of neutral D* and D candidates to satisfy 
140 MeV/c^ < AM < 145 MeV/c^. The selection efficiency is 6.2%, and the number of events 
satisfying selection criteria is 39. The background fraction is 12 it 4%. 

3 Determination of — ^ KaTv'^Tv~ decay model 

The amplitude / of the ii's7r"'"7r~decay is represented by a coherent sum of two-body 

decay matrix elements, each having its own amplitude and phase, plus one non-resonant decay 
amplitude. The total phase and amplitude are arbitrary. To be consistent with the CLEO 
analysis,^ we have chosen the Kgp mode to have unit amplitude and zero relative phase. The 
description of the matrix elements follows Ref. ^ 

For our model fit we use a set of 15 two-body amplitudes. These include four Cabibbo- 
allowed amplitudes: K*(892)+7r-, i^o*(1430)+7r-, i^2*(1430)+7r- and K*(1680)+7r", their doubly 
Cabibbo-suppressed partners, and seven channels with Kg and a tttt resonance: Kgp, KgU, 
Ksfo{980), Ks/2(1270), Ks/o(1370), Ksai and Ksa2. The masses and Breit-Wigner widths of 
scalars ai and (T2 are left unconstrained, while the parameters of other resonances are taken 
to be the same as in the CLEO analysis.^ The parameters of the a resonances obtained in the 
fit are as follows: M<,, = 539 ± 9 MeV/c^, T^, = 453 ± 16 MeV/c^, M^^ = 1048 MeV/c^, 

= 109 lb 11 MeV/c^. The resonance (T2 was introduced to describe a structure in the Dalitz 
distribution possibly due to the decay /o(980) rjrj with the rescattering of rji] to vr'^vr". 

We use the unbinned maximum likelihood technique to fit the Dalitz plot distribution. The 
fit function for the Dalitz plot density is represented by a sum of the squared absolute value of the 
decay amplitude and the background distribution, convoluted with a momentum 

resolution function and multiplied by the function describing efficiency. The free parameters of 
the minimization are the amplitudes and phases of the resonances, and the amplitude and phase 
of the non-resonant component. The background density for Kgir'^iT' events is obtained 

from AM sidebands. The shape of the efficiency over the Dalitz plot is extracted from a MC 
simulation. The fit result is presented in Table 1. 

4 Dalitz plot analysis of D^*^K^ decay 

The Dalitz plots of D decaying to KsiT~^Tr~ , which contain information about CP violation in B 
decays, are fitted by minimizing the combined logarithmic likelihood function for B~ and B~^ 
data sets. The corresponding Dalitz plot densities are based on decay amplitudes M± described 
by Eq. 1 (S+ data) and 2 {B~ data). The decay model / is fixed, and the free parameters 
of the fit are the amplitude ratio r and phases ^3 and 6. 

Since the background rate is significant, it is essential to include the background density 
into the fit model. The largest background contribution comes from continuum e~^e~ qq 
{q = u,d, s, c) events. It includes background with purely combinatorial tracks, and continuum 

mesons combined with a random kaon. This type of background is analyzed using an event 
sample in which cos Ot^r and Fisher discriminant requirements are applied in order to select 
continuum events. The continuum background fraction is 22. lib 3.9% for B^ — >■ DK^ mode and 
9.0 ± 3.6% for B^ D*K^ mode. The background due to BB combinatorics was investigated 



Table 1: Fit results for D" — > Ksir'^Tr decay. Errors are statistical only. 



Intermediate state 


Amplitude 


Phase (°) 


i4r*(892)+7r~ 


1.656 ± 0.012 


137.6 ± 0.6 


K*{892) 7r+ 


(14.9 ± 0.7) X 10 


325.2 ± 2.2 


ifo(1430)+7r" 


1.96 ± 0.04 


357.3 ± 1.5 


ifo(1430)"7r+ 


0.30 ± 0.05 


128 ± 8 


ifg (1430)+7r 


1.32 ± 0.03 


313.5 ± 1.8 


7"-^ :k / -1 A r\ \ — —I— 

if2(1430) 7r+ 


0.21 ± 0.03 


281 ± 9 


ii:*(1680)+7r" 


2.56 ± 0.22 


70 ±6 


ii:*(1680)~7r+ 


1.02 ± 0.2 


103 ± 11 





1.0 (nxedj 


(nxed) 


KgLO 


(33.0 ± 1.3) X 10-3 


114.3 ±2.3 




0.405 ± 0.008 


212.9 ±2.3 


ifs/o(1370) 


0.82 ±0.10 


308 ±8 


if,/2(1270) 


1.35 ± 0.06 


352 ±3 




1.66 ±0.11 


218 ±4 


KsCF2 


0.31 ±0.05 


236 ± 11 


non-resonant 


6.1 ±0.3 


146 ±3 



using the MC simulation. The fraction of BB background is 3.6 ± 0.3% for B — > DK mode 
and 3.1 ± 0.4% for B^ -> D*K^ mode. 

To test the consistency of the fit, the same procedure was apphed to the — > and 
B'^{B^) — > D*^7r^ control samples as to the B^ D^*^K^ signal. For decays of flavor cigcnstate 
of D meson, our fit should return r values consistent with zero. In the case of B^ vr^ a 

small amplitude ratio is expected (r ~ iKtft^c^l/lKbV^dl ~ 0.02). Deviations from these values 
can appear if the Dalitz plot shape is not well described by the fit model. For the control sample 
fits, we consider B~^ and B^ data separately, to check for the absence of CP violation. In the 
fit of B^ D-K^ data, we obtain r ~ 0.06 which is more than two standard deviations apart 
from zero, however, no CP asymmetry is found. This bias is considered as a systematic effect. 
Other control samples, B^ D*Tr^ with D*'^ decaying to L»°7r°, and i3"(i?") 0*^77^ with 
£)*± ^ D^TT^, do not show any significant deviation from r = 0. 

The combined unbinned maximum likelihood fit of B~^ and B~ samples with free parameters 
r, (j)3 and 5 yields the following values: r = 0.31 ± 0.11, ^3 = 86° ± 17°, 6 = 168° ± 17° for the 
B^ DK^ sample and r = 0.34 ± 0.14, ^3 = 51° ± 25°, S = 302° ± 25° for the B^ D*K^ 
sample. The method has a two-fold ambiguity (i?!)3 + tt, S + it), since this transformation does 
not change the total phases, which are actually measured. Here we choose the solution with 

< (f)3 < TT. 

The errors presented above are the estimation obtained from the likelihood fit. For a more 
reliable estimation of the statistical errors we use a Bayesian approach with the probability 
density function (PDF) of the fitted parameters obtained from a large number of MC pseudo- 
experiments. The MC procedure consists of a generation of two Dalitz plot samples of D^-D^ 
mixture (with total opposite flavor phases S — cps and S + cps) with the efficiency, momentum res- 
olution and background taken into account as in the fit of experimental data, with a subsequent 
fitting of this samples to extract the values of r, ^3 and 5. The number of events in the samples 
is taken nearly equal to the number of events in the experimental data. This procedure was 
repeated in several hundred trials for different values of input r parameter. The PDF is then 
parameterized to obtain the function describing the probability density of the reconstructed 
parameters for any set of true parameters. After the fitted parameters PDF is obtained, we 
assume a flat prior PDF and calculate the PDF for the true parameters. This procedure not 
only allows to obtain more reliable estimation of errors, but also corrects the systematic bias of 
the value of r introduced by the fit procedure due to its positive definiteness. 
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Figure 1: 03 probability density function for — > DK^ (dashed line), — > D*K^ (dotted line) and combined 

measurement (solid line). 

The result of the fit with errors (68% confidence level) obtained from the "toy" MC are 
as follows: r = 0.28t{j:??, (/)3 = 86 ± 20°, 5 = 168 ± 20° for S± ^ DK^ and r < 0.25, 
(/)3 = 51±47°, 8 = 302±47° for D*K^. The 95% confidence intervals are 0.07 < r < 0.45, 

37° < 4)-i < 135°, IW < 8 < 217° for DK^ and r < 0.44, -31° < (^3 < 133°, 

220° <6 < 384° for B^ D*K^ . The significance of CP violation is 94% for B^ -> DK^ and 
38% for B^ D*K^. Though the 68% CL error is quite small, the significance is comparatively 
low due to longer tails of the PDF compared to the gaussian distribution. 

We produce the combined measurement of (/)3 by multiplying the (/)3 PDFs for B^ DK^ 
and 5^ D*K^ modes. The resulting PDF, as well as the PDFs for individual measurements 
are shown in Fig. 1. The result of the combined measurement is 03 = 81 ± 19°, the 95% 
confidence interval is 35° < ^3 < 127°. 

The model used for the Z)*' KsTr~^TT~ decay is one of the main sources of systematic 
errors for our analysis. The model is a result of the experimental Dalitz plot fit, but since 
the plot density is proportional to the squared absolute value of the decay amplitude, the 
phase ^{m\,m'^) of the complex amplitude is not directly measured in the experiment. The 
phase dependence is therefore the result of model assumptions and its uncertainty may affect 
the D Dalitz plot fit. To estimate the model uncertainties, a MC simulation is performed. 
Event samples are generated according to the amplitude described by Eq. 1 with the resonance 
parameters extracted from our fit of continuum data, but to fit this distribution different 
models for f{m^,m-) are used. We scan the phases (p^ and 8 in their physical regions and 
take the maximum deviation of the fit parameter as a model uncertainty estimation. Since the 
Breit-Wigner amplitude, on which the model is based, can describe well only the narrow 
resonances, our estimation of the model uncertainty is based on the fit model containing only 
the narrow resonances, with the wide ones approximated by the constant complex term. The 
estimated value of the systematic uncertainty on (/>3 is 11°. 

Other sources of systematic errors include the uncertainties of the knowledge of the detector 
response, background estimation and possible fit biases. The component related to the back- 
ground shape parameterization is estimated by extracting the background shape from the Md 
sidebands and by using a flat background distribution. To estimate the contributions of efficiency 
shape evaluation and momentum resolution to the systematic error, we repeat the fit using a 
fiat efficiency and a fit model which does not take the resolution into account, respectively. 

The non-zero amplitude ratio observed in the B"^ — > Dtt"^ control sample can be either 



due to the statistical fiTictuation or may indicate some systematic effect such as background 
structure or a deficiency of the decay model. Since the source of this bias is indeterminate, 
we conservatively treat it as an additional systematic effect. The corresponding bias of the weak 
and strong phases is 11°. This contribution dominates in the systematic error, which equals to 
13° for S± ^ DK^ and 11° for S± ^ D*K^ mode. 

5 Conclusion 

We have studied a new method to measure the unitarity triangle angle 03 using Dalitz plot 
analysis of the three-body decay in the process B± D^*^K^. The first measurement 
of 03 using this technique was performed based on 140 fb~^ statistics collected by the Belle 
detector. Prom the combined fit of — > DK^ and — > D*K^ modes, we obtain the 
value of 03 = 81° it 19° ± 13° it 11°. The first error is statistical, the second is experimental 
systcmatics and the third is model uncertainty. The 95% confidence interval is 35° < 03 < 127° 
The statistical significance of the CP violation is 94% for B^ DK^ mode and 38% for 
5± ^ D*K^ mode. 

The method has a number of advantages over the other ways to measure 03.^ It is directly 
sensitive to the value of 03 and has only the two-fold discrete ambiguity (03 + tt, 5 + tt). It 
does not involve branching fraction measurements and, therefore, the influence of the detector 
systematics is lower. Also, the statistical power of this technique is higher in the presence of the 
background since the interference term is measured. 
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